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ABSTRACT 

We provide a preliminary estimate of the performance of reflex astrometry 
on Earth-like planets in the habitable zones of nearby stars. In Monte Carlo 
experiments, we analyze large samples of astrometric data sets with low to mod- 
erate signal-to-noise ratios. We treat the idealized case of a single planet orbiting 
a single star, and assume there are no non-Keplerian complications or uncer- 
tainties. The real case can only be more difficult. We use periodograms for 
discovery and least-squares fits for estimating the Keplerian parameters. We 
find a completeness for detection compatible with estimates in the literature. 
We find mass estimation by least squares to be biased, as has been found for 
noisy radial-velocity data sets; this bias degrades the completeness of accurate 
mass estimation. When we compare the true planetary position with the posi- 
tion predicted from the fitted orbital parameters, at future times, we find low 
completeness for an accuracy goal of 0.3 times the semimajor axis of the planet, 
even with no delay following the end of astrometric observations. Our findings 
suggest that the recommendation of the ExoPlanet Task Force (Lunine et al. 
2008) for "the capability to measure convincingly wobble semi-amplitudes down 
to 0.2 /ias integrated over the mission lifetime," may not be satisfied by an in- 
strument characterized by the noise floor of the Space Inter ferometry Mission, 
Cfloor ~ 0.035 /ias. An important, unsolved, strategic challenge for the exoplan- 
etary science program is figuring out how to predict the future position of an 
Earth-like planet with accuracy sufficient to ensure the efficiency and success of 
the science operations for follow-on spectroscopy, which would search for biolog- 
ically significant molecules in the atmosphere. 

Subject headings: astrometry, planetary systems 
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1. INTRODUCTION 

Today, the question of life in the universe is a compelling goal of scientific research. 
Finding such life would have vast implications for the human mind, consequences that seem 
real to everyone, even if difficult to express. Down through the ages, the uniqueness of Earth 
has been a stimulating issue for philosophers and ordinary people alike. Today, inspired 
by the discovery of many large planets around nearby stars, and propelled by progress in 
utilizing broad wavefronts of astronomical light, we can at last prepare to test the Earth's 
exceptionalism by means of large optical systems in space. 

An important, specific goal is to search for evidence of biologically significant molecules, 
particularly free oxygen, in spectra of the atmospheres of Earth-size planets located in the 
habitable zones of nearby stars — planets with likely surface temperatures in the range com- 
patible with water occurring in liquid form. Recently, the ExoPlanet Task Force of the 
Astronomy and Astrophysics Advisory Committee (Lunine et al. 2008) recommended — as a 
precursor to such direct detection and study — a space astrometry mission with "the capa- 
bility to measure convincingly wobble semi-amplitudes down to 0.2 /zas integrated over the 
mission lifetime," where the astrometric semi-amplitude for zero eccentricity is 

a = 3 — — uas . 1 

m s D P V ; 

Here, the range of a, which is the planetary semimajor axis in AU, is the habitable zone, or 
0.7-1.5 AU for a star of L s = 1.0 solar luminosity, and otherwise varying as \fL~ s \ m p is the 
planetary mass in Earth units; m s is the stellar mass in solar units; and D is the distance of 
the star in parsecs. For the Earth-Sun system observed at D = 10 pc, a = 0.3 /xas. 

There are several good reasons for the ExoPTF's recommendation on space astrometry. 
Nevertheless, there has been no detailed explanation of what the numerical goal "0.2 /zas" 
implies, either in terms of expected scientific performance or regarding the true requirements 
on a mission to achieve it. Is it a good number? Is it achievable by any currently planned 
astrometric mission? These questions are sharpened by the bias in least-squares estima- 
tion of Keplerian parameters near the sensitivity limit, most recently discussed by Shen & 
Turner (2008) for radial-velocity studies, and documented here for astrometry. Therefore, 
the immediate purpose of this paper is to expose some performance issues that attend reflex 
astrometry with noisy data using the least-squares estimator in most common use. (Al- 
ternative estimators might be less biased or unbiased. Bayesian estimation is identical to 
least-squares when the errors are normally distributed and the priors are flat, as in the exper- 
iments described here.) The ultimate goal is to find, if possible, a coherent program of space 
astrometry and follow-on coronagraphic spectroscopy of Earth-like planets that reasonably 
fulfills the expectations of the community, as well as the public. 
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In the first instance, our expectations are that astrometry can overcome three technical 
difficulties that have been identified with the direct-detection approach: (1) low search com- 
pleteness per observation, implying many long exposures with no results, (2) low final search 
completeness for many high-priority stars, due to a high fraction of permanently obscured 
habitable- zone orbits, and (3) low probability of recovering in the future any planets that are 
discovered, because of the difficulty in estimating the planetary orbit from the limited range 
of the few direct astrometric measurements that might be obtained in the first observing 
season — the season of discovery — before the target is lost in the Sun (Brown 2005; Brown, 
Shaklan, & Hunyadi 2007; Pravdo et al. 2007). 

Of no less importance, at least qualitatively, our expectations are also scientific, namely 
that astrometry will provide important physical information that direct detection cannot 
provide, particularly estimates of the planetary mass, which controls atmospheric structure 
and composition, and orbit size, which determines the planet's thermal regime. Such in- 
formation is basic for understanding the planet's physical conditions and, indeed, its very 
identity. It may also provide clues about a planet's origins and dynamical evolution. 

Planets cannot hide from astrometry, except in the noise. In principle, only astrom- 
etry can measure the true mass and determine all the orbital elements. In principle, only 
astrometry can ensure that follow-on spectroscopy is planned with accurate predictions of 
the separation, position angle, and brightness of the planet at future times. In practice, 
however, as we show here using the completeness metric, these expectations may not be sat- 
isfied by the design parameters currently associated with the observing system most strongly 
advocated for the task, the Space Astrometry Mission, light version, or SIM Lite. 

2. THE BASICS 

We assume an idealized astrometric instrument, which measures the two-dimensional 
position of the star relative to a local astrometric reference frame on the sky. An idealized 
astrometric data set comprises N measurements of the form (ti, Ti, Xi, yi, <7j): the x-y position 
at epochs ti spread over duration T, longer than one planetary period, where the exposure 
time is 0.5 Tj for each of the two quasi-orthogonal directions, and where <7j = ooCW 7 *) 1 ^ 2 is 
the positional uncertainty in either direction. We assume the astrometric errors are normally 
distributed. 

Assuming that D is known from the annual parallax and that m s is known from stellar 
spectrophotometry, the theoretical apparent position of the star is fully described by seven 
Keplerian parameters, of which three are physical properties of the system (a, eccentricity e, 
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and m p ), three are Eulerian rotations of the orbit with respect to the line of sight (argument 
of periastron u, inclination angle i, and longitude of the ascending node Q), and one specifies 
the orbital phase at a moment in time, such as at the epoch of the first data point (initial 
mean anomaly M ). Currently, we consider only planetary orbits with periods significantly 
shorter than T. 

We consider a subset of the universe of astrometric reflex signals due to planets on 
randomized habitable-zone orbits for which a is uniformly distributed in the habitable- zone 
range Q.7^fL~ s < a < e is uniformly distributed over < e < 0.35; and uj, i, and Q 

are randomized to distribute the orbit pole uniformly on the sphere. The subset of signals we 
consider is made up of those for which a key characteristic, the astrometric signal-to-noise 
ratio SNR, 

SNR = a/a , (2) 

is sufficiently small to approach the limits of useful scientific performance. Here, the "mission 
error" for a star is 

o- = <W /2 ($^ i=1 T i) = a oro /2 T- 1/2 , (3) 

where r is the total exposure time. The noise reduction in Eq. 3 with r and N is valid only 
down to the noise floor, or for a > Ofl oor , where 0"fl O or is determined by systematic effects. 

SNR can be small due to any combination of the several instrumental, observational, 
and physical parameters appearing in Eqs. 1, 2, and 3. Nevertheless, our interest is focused 
on a ~ 0.2 yuas, which is the ExoPTF's recommended goal, as well as 2/3 the iconic value for 
the Earth-Sun system at D = 10 pc. (Due to orbital eccentricity and the arbitrary alignment 
of the orbital major axis with respect to the line of sight, a may be larger or smaller than 
the semi-major axis of the apparent orbital ellipse on the plane of the sky.) 

We use the completeness metric C(SNR) to estimate scientific performance. We define C 
as the fraction of possible planets with the characteristic SNR that are successfully observed, 
assuming the planet is present. "Successfully observed" variously means (1) that the planet 
is detected by periodogram analysis of the data, or if it is detected, (2) that the planetary 
mass is, or (3) future position is, usefully estimated from the orbital solution produced by a 
least-squares fit of the parameters of the Keplerian theory to the noisy data set. 

3. PREVIOUS PERFORMANCE ESTIMATES FOR SIM LITE 

Traub et al. (2009) is the most recent discussion of the scientific performance of space 
reflex astrometry on Earth-like planets, assuming the design parameters of SIM Lite. That 
paper reports the preliminary findings of a JPL-sponsored study in which one "goal was to 
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see what accuracy of SIM Lite is needed to detect Earth-like planets." The study builds 
on earlier analyses by the SIM science team of variants of the SIM mission, including 
Catanzarite et al. (2006) and Unwin et al. (2008). The findings have been reiterated by 
the astrometry committee of the JPL-sponsored 2008 Exoplanet Forum (Lawson, Traub, 
& Unwin 2009; Muterspaugh & Tanner 2009). One purpose of that forum was to inform 
the Decadal Survey of Astronomy and Astrophysics (Astro2010) "concerning technology 
development and technology readiness of proposed exoplanet missions," in this case, SIM and 
its variants. The forum report urges that a SIM-type astrometry mission be implemented 
forthwith. It cites the ExoPTF finding "that for the 11-15 year (2019-2023) timeframe, 
'Assuming the space-borne astrometric mission described above is fielded in the second time 
epoch, no additional major space-based astrometric effort is envisioned in this time frame.' 
The committee agrees with this conclusion." 

We infer the following common denominators of the studies and reports mentioned in 
the previous paragraph. 

1. For SIM Lite, the instrumental parameters are <Jq = 1.41 //as, r = 2200 sec, and 
o"fioor = 0.035 //as, which from Eq. 3 implies A max = 1600 and r max = 3.6 x 10 6 sec. For 
a = 0.2 //as (ExoPTF) or a = 0.3 //as (Earth-Sun at 10 pc), SNR mSuX = 5.7 or 8. We 
accept these numbers as given. 

2. For detection via periodogram (power spectrum), SNR = 5.8 is required for search 
completeness C = 0.5 with a false-alarm probability fap = 0.01. We agree with this, 
finding the value is closer to SNR = 6.0 for our adopted planetary population, as shown 
below. In any case, the SIM Lite search completeness for the ExoPTF's a = 0.2 //as 
is C « 0.5. 

3. Estimates of planetary mass are achievable with accuracy "close to the theoretically 
expected value" from the minimum-variance bound or Cramer-Rao limit (Traub et al. 
2009, Gould 2008). Using the least-squares estimator, we differ, but actually it depends 
on the meaning of "close." We show below that, because the least-squares estimator 
of mass is biased, the completeness C of even roughly accurate estimates of mass for 
Earth-like planets is significantly degraded in the SIM Lite domain of a > a aoor xs 
0.035 //as. 

4. The estimates of the orbital period approach the minimum-variance bound. We agree. 
Just as Shen & Turner (2008) found for radial-velocity data sets, for example, we find 
no sign of bias for period estimation via least-squares fitting of noisy astrometric data 
sets. 
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5. Other than our studies reported below, we are not aware of any previous tests of 
the ability to accurately predict future planetary positions from the analysis of noisy 
astrometric data sets. Nevertheless, the literature contains fulsome assertions about 
the adequacy of STM-based positional predictions, even if their basis has not been 
explained. Unwin et al. (2007): "For many of these stars, <S7M's orbital solution will 
be precise enough to predict the best timing for a direct observation. This information 
is crucial for direct imaging, since a planet in the habitable zone can spend much 
of its time hidden in the glare of the planet star." Lunine et al. (2008): "Because 
the astrometric mission would have already determined the locations ('addresses') and 
orbits of the candidate planets, the spaceborne direct detection system is relieved of 
the burden of searching; its mission is to point at those stars and study the planets. 
This greatly simplifies a direct detection mission in several ways: . . . The target list 
can be ordered and prioritized ahead of time to maximize efficiency in moving from 
one target to another and in observing those targets whose orbital phases make them 
most observable..." Muterspaugh & Tanner (2009): "Astrometric observations of 
stars hosting Earth-like planets allow the orbits to be determined. The position of the 
planet can be predicted as a function of time. This provides a solid basis for future 
planning [of] direct imaging programs, as the observing schedule can be set to look 
at the targets when the star and planet are most optimally configured for isolating 
light from the planet." In the current study, we do not confirm these assertions using 
the least-squares estimator of the Keplerian parameters. In the SIM Lite performance 
domain, we find low C for even roughly accurate predictions of the future positions of 
Earth-like planets. 



4. DISCOVERY VIA PERIODOGRAM 

Currently, the most popular algorithm to search noisy data for faint periodic signals 
is the periodogram, Z(f), where / is the angular frequency. In this paper, we use the 
most popular normalization of the periodogram, which subtracts the mean value of the 
measurements and divides by the standard deviation of the data set (Lomb 1976; Scargle 
1982; Home & Baliunas 1986). Recently, the theoretical basis for closed-form estimates 
of periodogram performance has collapsed spectacularly (Frescura, Engelbrecht, & Frank 
2008). A new calibration approach, based wholly on Monte Carlo methods, is now emerging 
(Catanzarite et al. 2006), and is followed here. 

For two-dimensional astrometry, we use the "joint" periodogram defined by Catanzarite 
et al. (2006). 
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Instead of selecting the maximum peak value Z max at a finite list of "independent 
frequencies" — a now-discredited theoretical concept, particularly for arbitrarily spaced data — 
we locate the true peak in the continuous range of frequencies between the fundamental, 
27r/T, and the Nyquist frequency, 7rN/T. (Orbital frequencies in the habitable zone are 
always near the short end of this range.) 

At its performance limits, discovery via periodogram is based on selecting a value of 
fap, then estimating the threshold value for the maximum peak, threshold) of Z(f) such that 
data sets of pure noise — with no periodic signal present — produce Z max pca k > threshold with 
a probability equal to fap. The value of threshold depends on N, but not on the timing of 
the data points. For all the periodogram analysis report here, we adopted fap = 0.01, and 
we estimated the values of threshold f° r given N from 100,000 data sets of pure noise. 

For discovery, we are interested in the search completeness C(SNR), which is the fraction 
of random planets with given SNR that are detected by the criterion Z max pca k > -^threshold- 
For this purpose, we prepared 880,000 random data sets at spaced values of SNR in the 
range 5 < SNR < 100, then subjected the data sets to periodogram analysis. The results 
are shown in Fig. 1. We confirm that C = 0.5 is achieved at SNR xs 6. This result — indeed 
the value of C at any SNR — depends somewhat on the assumed planetary population. For 
example, face-on orbits achieve the highest C at any SNR, and high eccentricity degrades 
C, due to the spectral power distributed into harmonics. 

The shaded region of Fig. 1 is the range of SNR that is excluded for SIM Lite on 
Earth-like planets at 10 pc, SNR max m 8. At SNR max , C = 0.85 for discovery. 

In the process of conducting these periodogram investigations, we confirmed that search 
completeness C depends on the parameters a, o, r, and iV only as they are combined in the 
SNR characteristic according to Eqs. 2 and 3, as expected from the literature. 

5. MASS ESTIMATION 

At spaced values of SNR in the range 5 < SNR < 100, we found orbital solutions for 
265,000 data sets in which periodogram analysis had discovered a planet. We compared the 
true value of the planetary mass, m p (true) — the value with which the data set was prepared— 
with the estimated value, m p (est), found by a least-squares orbital fit to the data. In this 
application, C(SNR) means the fraction of data sets with the value of SNR for which the 
fractional error, (m p (est)-m p (true))/m p (true), occurs in a specified range centered on zero. 
Fig. 2 shows the results for the ranges ±10% and ±25%. We see that for the mass-estimation 
accuracy ±25%, C < 0.70 for SNR < 8, and for ±10% accuracy, C < 0.35. 
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The dashed lines in Fig. 2 show the performance associated with the minimum-variance 
bound (Gould 2008). At this bound, the expected fractional error in mass is V2/SNR, and 
the normalized deviations — observed fractional errors in mass times SNR/V2— should be 
normally distributed with mean zero and unit variance (Traub & Gould 2008). Therefore, 
for mass estimation accuracy q, which equals 0.1 or 0.25 for the cases shown, the completeness 
associated with the minimum-variance bound is 



where erf is the error function. Comparing the dashed and solid curves, it is clear that the 
performance estimated by these Monte Carlo simulations, using least-squares estimation, 
falls significantly short of that expected from the minimum- variance bound for SNR < 8. 

A closer look at the normalized deviations (Fig. 3) reveals the reason for the reduction 
of C for mass estimation from the minimum-variance bound: the least-squares estimator 
produces biased estimates of mass from noisy astrometric data sets, just as Shen and Turner 
(2008) found for noisy radial- velocity data sets. 

In the process of conducting these mass investigations, we confirmed that C for accurate 
mass estimation depends on the parameters a, a, r, and iV only as they are combined in 
SNR according to Eqs. 2 and 3. 

6. PREDICTIONS OF THE PLANETARY POSITION AT FUTURE TIMES 

Habitable- zone orbits of nearby stars are highly obscured, with many possible planets 
peeking out only for short times from behind a central field obscuration. Also, suppression 
of starlight may be easier to achieve in a smaller region of the focal plane. In response to 
these considerations, we suggest that a positional accuracy of 30% the semi-major axis — 
±0.3 a — is a reasonable first estimate of a possible requirement on astrometry to support 
the planning of direct observations of the planet. 

We analyzed the same sample of 265,000 pairs of true and fitted orbital solutions dis- 
cussed in the previous section to estimate performance in predicting the planetary position. 
The six solid curves in Fig. 4 show C(SNR) for the positional metric better than ±0.3 a 
after 0-20 years have elapsed after the end of the 5-year duration of astrometric observations. 
The positional metric is defined as the norm of the vector deviation between the true and 
estimated planetary positions on the plane of the sky. For SNR < 8, we find C < 0.5 after 
more than one year has elapsed, and C < 0.2 after ten years. 




(4) 
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For a further, more elaborate, metric of recoverability, we considered the time interval of 
one (estimated) orbital period following the end of astrometric observations. We computed 
the true position of the planet for each day from the true orbital elements, and computed 
the estimated position from the estimated orbital elements. Next, we identified the subset 
of days for which the planet was predicted (from the estimated elements) to have a greater 
separation from the star than 0.7 a, which seems like a reasonable definition of when follow- 
up spectroscopy should be planned. Next, we checked on those days whether the norm of the 
deviation between the true and estimated positions of the planet was less than 0.3 a, which 
seems like a reasonable working size of the dark hole that a coronagraph might create around 
the entrance aperture of a spectrometer. At each SNR, we counted the number of days for 
which both these criteria were satisfied, and divided it by the number of days only the first 
was met. This recoverability metric tends to unity in the limit of excellent predictions, at 
high SNR. If the metric is > 0.95, say, it means that the planet is recovered (within 0.3 a 
of the estimated location) for > 95% of the days that the data predicts the planet to be 
observable (outside 0.7 a). Preliminarily, we define a planet as "recovered" if the metric is 
> 0.95. The dashed red line in Fig. 4 shows C(SNR), the recovery completeness by this test, 
C < 0.1 for SNR < 8. 

In the process of conducting these positional investigations, we confirmed that C de- 
pends on the parameters a, a, r, and N only as they are combined in the SNR characteristic 
according to Eq. 2. 

7. DISCUSSION 

Our preliminary analysis suggests that the scientific performance on Earth-like planets 
of a space astrometry mission characterized by cr fioor rs 0.035 /ias may not satisfy expecta- 
tions, particularly, the ExoPTF recommendation for "the capability to measure convincingly 
wobble semi-amplitudes down to 0.2 /ias integrated over the mission lifetime," particularly 
in estimating the planetary mass and future planetary position. The reason for this under- 
performance is that the maximum astrometric signal-to-noise ratio, SNR mSuX = a/Ta oor = 5.7 
for a = 0.2 //as, which is the SNR required for ~50% discovery completeness, is well below 
the SNRs required for high completeness of accurate estimates of planetary mass and future 
positions. 

In the case of mass estimation, the degradation from the minimum-variance bound is 
only quantitative, and perhaps not a serious problem for science. For example, we expect 
that meaningful and useful upper limits to the planetary mass can still be set by reflex 
astrometry, as is customary for the radial- velocity technique. 
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In the case of predicting the planetary position, the problem is qualitative and more 
serious. Knowing where and when to place the entrance aperture of the spectrometer is a 
huge science-operational issue for the follow-on mission, due to the very long exposure times. 
We had hoped that <57M-class astrometry would be a solution, but now that appears not to 
be the case, at least for the most interesting planets in terms of life, which are the Earth-like 
planets at typical distances of 5-20 pc. 

The bias in least-squares estimation of the Keplerian parameters certainly contributes 
to the error in positional predictions. 

This paper reports only a preliminary analysis, not yet taking into account the charac- 
teristics of individual stars, which affect both astrometric performance and follow-up coron- 
agraphic spectroscopy. Also, we treat the idealized case of a single planet orbiting a single 
star, and assume there are no non-Keplerian complications or uncertainties — such as due to 
multiplicity, proper motion, parallax, stellar activity, reference-frame errors, etc. The real 
case can only be more difficult. 

The findings presented here are a source of concern about the true answer to the question 
posed by Traub et al. (2008): "What accuracy of SIM Lite is needed to detect Earth-like 
planets?" 

We hope and expect that these results will motivate a critical reexamination of exo- 
planetary program strategies involving space astrometry. We must ensure either that an 
adequate technical solution for reflex astrometry is part of the plan, or we must define a 
programmatic pathway toward spectroscopy on Earth-like planets that is less dependent on 
reflex astrometry. 

An important unsolved, strategic problem in the exoplanetary science program is figur- 
ing out how to predict the future position of an Earth-like planet with accuracy sufficient 
to ensure the success of the science operations of a follow-on spectroscopic mission, which 
would search for biologically significant molecules in the atmosphere. 

I appreciate Jeremy Kasdin's raising the issue of the accuracy of the planetary ephemeris, 
and Remi Soummer's calling this to my attention. I thank Christopher Burrows for inter- 
esting discussions, both directly and indirectly related to this work. I thank Christian Lallo, 
for making the computations possible, and Sharon Toolan for her excellent help preparing 
the manuscript. 
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Fig. 1. — Discovery search completeness of reflex astronometry as a function of SNR. C is 
the fraction of possible planets drawn from the assumed population that are detected by 
periodogram with fap = 0.01. The shaded region is denied to SIM Lite (rfl oor = 0.035 /zas) 
for a < 0.3 /ias, which is the reflex semi-amplitude of the Earth-Sun system observed from 
D = 10 pc. 
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Fig. 2. — Completeness of mass estimation with ±10% and ±25% accuracy. Solid: results of 
Monte Carlo experiments in which orbital solutions for 265,000 noisy data sets were obtained 
by least-squares fits. Dashed: the predicted completeness if mass estimation achieved the 
minimum-variance bound — which it does not here, due to bias in the least-square estimator. 
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Fig. 3. — Bias in estimating m p by least-squares fit of Keplerian parameters to astrometric 
data sets. Histogram of the fractional deviation of the estimated mass from the true mass 
multiplied by SNR/ \/2, which should produce a normal distribution with zero mean and unit 
variance for estimation satisfying the minimum- variance bound (Traub & Gould 2008). The 
indicated bias accounts for degradation in C for accurate mass determination, as indicated 
by the separation of the solid and dashed curves in Fig. 2. 
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Fig. 4. — Various completeness measures of the accuracy of predicting the future planetary 
position from orbital solutions obtained by least-squares fits to noisy astrometric data sets. 
Solid: the completeness of positional estimates within ±3 a for 0-20 years delay, as indicated, 
after the 5-year duration of observations. Dashed: results of a recovery metric test described 
in the text. 



